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In the Claims: 

Amend the claims as follows: 

} jstino of Claims 

1 . (Currently amended) A method for creating a multidimensional visual 
representation of a group of data elements having integrated temporal and 
spatial properties, the data elements being included in the visual representation 
as a corresponding plurality of v isual elements, t he dal a u tomonto of th n g m . . p 
linked by at loaot ono aoooolation, - the method comprising the steps of : 

gpGombl i ng tho group of data o l omcnto uoing tho at Icaot ono aooooin tio r>7 
generating a spatial domain of the visual representation to include a 
reference surface for providing a spatial reference frame having at least two 
spatial dimensions, the reference surface for relating a first visual element ofthe 
ninralitv of visual elements representing a first data element of the group to a first 
location of interest in the spatial reference frame and relating a second visual 
element of the plurality nf visual elements representing a second data element of 
the group to a second location of interest in the spatial reference frame; 

generating a temporal domain of the visual representation operatively 
coupled to the spatial domain, the temporal domain for providing a common 
temporal reference frame for the locations of interest, the temporal domain 
including a first time track coupled to the first location of interest and a second 
time track coupled to the second location of interest, the first visual element 
positioned on the first time track and the second visual element positioned on the 
second time track, each of the time tracks extending with respect to the reference 
surface and c onfigured for visually representing a respective temporal sequence 
of a plurality of the data elements at each of the locations of interest eMhe 
roforonoo ourfaco ; 

positioning a respective instant of focus at the intersection region between 
each of the time tracks and t h e reference surface at the respective locations of 
interest, the instant of foci being u ^ri for visually distinguishing a range of Past 

Gowling Lafleur Henderson LLP Pa 9« 3 

T8468092US\TOR_LAW\6313661\1 
PAGE 8/33 • RCVD AT 5/26/200e 2:38:24 PM (Eastern Daylight Time) * 8VR:U8PTO-EFXRF-5/21 • DNI8:273830O * CSID: * DURATION (mm-ss): 14-42 



05/26/06 13:59 FAX 



@009 



tirng in th» temoora ' domain Brgcedipg fee infant of foci and a range of fyty rg 
Hm. in fljg turmo il do jpaln afiSI the iDStaPi of foci, each of the instant of foci 
™ n f in,.rpri for gy nrhp pn.- rP PQS . « ^.nn alonn their wwrwtivft one of the time 
tracks : and 

assigning a connection visual element in the visual representation 
between the first visual element and the second visual element, the connection 
visual element for representing* an dtetrfeuted association daJbuJfidJn at least 
one of the domains between the first visual element and the second visual 
element; 

wherein the visual representation is displayed on a user interface for 
subsequent interaction with user events. 

2. (original) The method of claim 1 , wherein the visual representation of the 
group of data elements is selected from the group comprising; a concurrent time 
and geographic context and a concurrent time and diagrammatic context. 

3. (Currently amended) The method of claim 2, wherein the diagrammatic 
oontext includes a plurality o f nodes of a defined process, such that one of the , 
nodes is posted at the fi r st location of interest and a second one of the nodfis . 
is positioned at the second location of interest, l uithor oompr i oing tho itop o f 
conf i guring tho roforonoo curfaoo for providing an Inotant of foouo i n tho temp o ral 
roforonoo framo for at l oaot oomo of tho tompora l and spatia l proportioo of the 
group of data olomonto, tho inotant of foouo ooup l od to tho l ooat i ono of I ntoront o f 
tho roforonoo ourfaco, tho i notant of foouo colootod by tho uoor ovonto. 

4. (Currently amended) The method of claim 3 further comprising the step of 
configuring cr^Ht yinn a time range of t he temporal reference frame for prov i ding 
a timo range selected from the group comprising: a thejaast range of past time of , 
the temporal sequence preceding the instant of focus; and a thejtrtwe range of 
future time of the temporal sequence after the instant of focus. 
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5. (Currently amended) The method of claim 4,1 further comprising the step 
of intersecting each of t he first time tracks through the first their respectiv e 
location of interest such that the past ranges of the first time tracks extends from 
one side of the reference surface and the future ranges of the first time tracks 
extends from the other side of the reference surfa ce, the l iibtont of f n oun Inmt o ri 
on the f l rcttimo track at tho i ntomootion point botwu un tho f i rott l m n track and tho 
roforonco Gurfac e. 

6. (Currently amended) The method of claim 5 further comprising the step of 
arranging a-first the_plurality of the visual elements along the first time tracks 
according to the times at which the rorrespondina visual data elements occurred 
in the temporal reference °* ^ ™° " f the pluralitv of tne vlsual 
laments beinfr mrtenendent a n ri as such beinn not related to either of the first 

anri second visu al elements. 

7. (cancelled) 

8. (Currently amended) The method of claim 7- ^further comprising the step 
of arranging a-6esendlhe_plurality of the visual elements along the eeeend time 
tracks according to the times at which the corresponding data visual elements 
occurred in the temporal reference fram e , thft type of the data elements selected 
fmm tho nmup comprising: entities: e x/ants: locations: and associations,- 

9. (Currently amended) The method of claim 6, wherein the location in the 
temporal reference frame of each of the plurality of visual elements on the time 
tracks is proportional to the distance from the instant of feeue focLassociated with 
the reference si * Ho * YP» pj M elements selected from the group 
rom prisinn: entities: e vents: locations: and associations. 

1 0. (original) The method of claim 9, wherein the time tracks are represented 
as timelines in the visual representation. 
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1 1 . (original) The method of claim 1 0, wherein the temporal reference frame 
has a scale selected from the group comprising linear and logarithmic. 

1 2. (Currently amended) The method of claim 2 further comprising the step of 
maintaining an orientation of the time tracks with respect to the reference surface 
such that changes In the attitude viewing orientation of the reference surface in 
response to the user events results in a corresponding change in the yjewjng 
orientation of the time tracks. 

1 3. (Currently amended) The method of claim 1 2, wherein the orientation 
angle between the time tracks and the reference surface is 90 degrees. 

1 4. (Currently amended) The method of claim 2 further comprising the step of 
maintaining an orientation of the time tracks with respect to the reference surface 
such that changes in the viewing orientation a ttitude of the reference surface in 
response to the user events does not result in a corresponding change in the 
viewing o rientation of the time tracks such that the time tracks are maintained jp 
a vertical orientation . 

1 5. (original) The method of claim 1 4, wherein the orientation of the time 
tracks is such that the length of the time tracks is maximized as perceived by a 
user of the user interface. 

1 6. (Currently amended) The method of claim 2 further comprising the step of 
overlapping a time chart on the first time track and onthe second time track, the 
time chart having a time axis and a spatial axis for representing the temporal 
reference frame and at least one of the spatial dimensions respectivel y, such that 
visual reference elements between the tim e axis and the time tracks are 
maintained as a new spatial orientatio n of the spatial reference frame is selected 
and the time tracks in the time chart remain con tinuously connected across the 
time rhart and the social reference frame so that the time tracks in the time chart 
are repositioned to correspond to th e new spatial orientation. 
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17. (cancelled) 

18. (cancelled) 

19. (cancelled) 

20. (cancelled) 

21 . (cancelled) 

22. (Currently amended) The method of claim 2, wherein types of the data 
elements are selected from the group comprising; entity, location, association, 
and event. 

23. (original) The method of claim 22, wherein the event data element type 
represents an action taking place at a particular one of the locations of interest in 
the spatial reference frame and at a particular time in the temporal reference 
frame. 

24. (Currently amended) The method of claim 23, wherein the event data 
element type has data properties and display properties selected from the group 
comprising; a short text label, description, location, start-time, end-time, general 
event type, icon reference, visual layer settings, priority, status, user comment, 
certainty value, source of information, default* and. user-set color, reference 
document, and reference photograph. 

25. (original) The method of claim 22, wherein the entity data element type 
represents an actor involved in a selected event. 

26. (Currently amended) The method of claim 25. wherein the entity data 
element type has data properties and display properties selected from the group 
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comprising; short text label, description, general entity type, icon reference, 
visual layer settings, priority, status, user comment, certainty value, source of 
information, default + and_user-set color, and reference document, and reference 
photograph. . 

27. (original) The method of daim 22. wherein the location data element type 
represents a location within the spatial reference frame. 

28. (original) The method of claim 27, wherein the location data element type 
has data properties and display properties selected from the group comprising; 
position coordinates, a label, description, color information, precision information, 
location type, non-geospatial flag and user comments, reference document, and 
reference photograph. 

29. (Currently amended) The method of claim 28, wherein the location data 
element type is selected from the group comprising; a physical location on a 
geospatial map. a physical location as a node in a diagram, and a virtual location 
related to a geospatial map such that the v irtual location is not assigned to a 
g panif in nhvsical location on the nftosoarJal map. 

30. (Currently amended) The method of claim 22, wherein the at loact one 
association describes a pairing between two or more of the data elements for 
providing an information data object rela ted to both of the two or more data 
elements . 

31 . (Currently amended) The method of claim 30, wherein the connection 
visual element is a ©eHd selected l ine tyoejrepresenting a direct connection 
between the first visual element and the second visual element. 

32. (Currently amended) The method of claim 3430., wherein the information 
data object is selected from the grou p comprising: a communication connection 
describing communication details transferred be tween the two or more data 
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elements: a financial trans action or other transaction: and a relationship 
connection describing soc ial details in common between the two or more data 
elements, oolid lino hao a pointor for indicating a vootor proporty of tho vloual 
oonnootion olomont . 

33. (cancelled) 

34. (Currently amended) The method of claim 2 30, wherein the association is 
predefined or is created due to user Interact ion with the visualization 
representation, furthor oompricing tho otop of updating tho v i oual o l omontc in tho 
vioua l repres e ntation i n rooponco to tho usor ovonts. 

35. (Currently amended) The method of claim 34-1, whoroin tho uoor ovonte 
om jnnnntnri i n mr . pnnr.n to further comprising the s t ep of manipulating*^ the. 
position of the instant of foci on the time tracks for f acilitating bv tho uoor of an 
intnmntiw n nnntm i fnr mnd i fvinn synchronous m odification of the v isual properties 
of the plurality of visual elements on the t ime tracks. 

36. (Currently amended) The method of claim 35, wherein synchronous 
modification of the visual properties of the plu rality of visual elements includes 
concurrent and continuous updating as the instant of foci are repositioned on the 
time tracks, tho intcraotivo contro l i o oolootod from tho group compr i oing a timo 
rango colootor and an inotant of foouo oo l ootor. 

37. (Currently amended) The method of claim 35 further comprising the step 
of adding at least one further visual element on on e of the time tracks animat i ng 
tho dioplay of at loaot ono of tho vioual olomonto of tho v i oual roprocontation In 
response to the manipulation of the instant of foc i with respect to a selected time 
ranoe in the temporal reference frame intoraotivo contro l. 

38. (Currently amended) The method of claim 35 7, whoroin further comprising 
the step of chancing t he Htepia yad visual properties of the connection visual 
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element oftho v i cua l roprocontation io animat e d in response to the manipulation 
of the Instant of foci intoraotivo control s. 

39. (Currently amended) The method of claim 38, wherein the connection 
visual element is eeupted associated with * e the movement of an entity visual 
element across the visual representation between the first location of interest and 
the second location of interest, the entity visual element representing an actor 
involved in a selected event. 

40. (Currently amended) The method of claim 35 further comprising the step 
of applying a filtering function to the visual elements and the at least one related 
association to select a subgroup thereof, selection of the subgroup according to a 
method selected from the group comprisin g: criteria matching, algorithmic 
methods, and manual selection . 

41. (cancelled) 

42. (cancelled) 

43. (Currently amended) A system for creating a multidimensional visual 
representation of a group of data elements having integrated temporal and 
spatial properties, the data elements being included in the visual representation 
as ^corresponding plurality of v isual elements, tho data olomontc of tho group 
li nked by at loaot ono aooooiat i on, the system comprising: 

a visualization manager for assembling the group of data elements using 
tho at loaot ono aGCoeiat i on and for assigning a connection visual element in the 
visual representation between a first visual element of the plurality of visual 
elements representing a first data element of the group and a second visual 
element of the plurality of visual elements representing a second data element of 
the group; 

a spatial visualization component configured for generating a spatial 
domain of the visual representation to include a reference surface for providing a 
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spatial reference frame having at least two spatial dimensions, the reference 
surface for relating the first visual element to a first location of interest in the 
spatial reference frame and relating the second visual element to a second 
location of interest in the spatial reference frame; and 

a temporal visualization component configured for generating a temporal 
domain of the visual representation operatively coupled to the spatial domain, the 
temporal domain for providing a common temporal reference frame for the 
locations of interest, the temporal domain including a first time track coupled to 
the first location of interest and a second time track coupled to the second 
location of interest, the first visual element positioned on the first time track and 
the second visual element positioned on the second time track, each of the time 
tracks extending with respect to the reference surface and c onfigured for visually 
representing a respective temporal sequence of a plurality of the data elements 
at each of the locations of interest of tho roforonoo ourfaoo ; and 

an interactive control component for positioning a resp ective instant of 
focus at the Intersection region between each of the time t racks and the 
reference surface at the respective locations of interest, the i nstant of foci being 
used for visually distinguishing a range of oast time in the temporal domain 
preceding the instant of foci and a range of future tim e in the temporal domain 
after the instant of foci, each of the instant of foci configured for synchronous 
repositioning along their respective one of the time tracks ; 

wherein the connection visual element represents an a distr i buted 
association distributed in at least one of the domains between the first visual 
element and the second visual element such that the visual representation is 
displayed on a user interface for subsequent interaction with user events. 

44. (Currently amended) A computer program product for creating a 
multidimensional visual representation of a group of data elements having 
integrated temporal and spatial properties, the data elements being included in 
the visual representation as a corresponding plurality of visual elements, tho data 
olcmonts of tho group li nked by at loast ono associatio n the computer program 
product comprising: 
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a computer readable medium; 

a visualization module stored on the computer readable medium for 
assembling the group of data elements us i ng tho at loaot ono aooociat i on and for 
assigning a connection visual element in the visual representation between a first 
visual element r>f the plurality o f visual elements representing a first data element 
of the group and a second visual *iam ft nt 9 f the plurality of visual elements 
representing a second data element of the group; 

a spatial visualization module stored on the computer readable medium 
for generating a spatial domain of the visual representation to include a reference 
surface for providing a spatial reference frame having at least two spatial 
dimensions, the reference surface for relating the first visual element to a first 
location of interest in the spatial reference frame and relating the second visual 
element to a second location of interest in the spatial reference frame; and 

a temporal visualization module stored on the computer readable medium 
for generating a temporal domain of the visual representation operatively coupled 
to the spatial domain, the temporal domain for providing a common temporal 
reference frame for the locations of interest, the temporal domain Including a first 
time track coupled to the first location of interest and a second time track coupled 
to the second location of interest, the first visual element positioned on the first 
time track and the second visual element positioned on the second time track, 
each of the time tracks extending with resnact to the reference surface and 
configured for visually representing a respective temporal sequence of a plurality 
of the data elements at each of the locations of interest e f tho roforonco ourfaco ; 
and 

an interactive control component for po sitioning a respective instant of 
focus at the intersection region bet ween each of the time tracks and the 
reference surface at the respective leg ations of interest, the instant of foci being 
used for visually distinguishing a rana e of oast time in the temporal domain 
preceding the instant of foci and a range of future time in the temporal domain 
after the instant of foci, each of the ins tant of foci configured for synchronous 
repositioning along their respec tive one of the time tracks; 
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wherein the connection visual element represents a an d i ctributod 
association distributed in at least one of the domains between the first visual 
element and the second visual element such that the visual representation is 
displayed on a user Interface for subsequent interaction with user events. 

45. (new) The method of claim 4 further comprising the step of specifying the 
range of past time independently from the range of future time. 

46. (new) The method of claim 4 further comprising the step of specifying the 
range of past time and the range of future time independently from the instant of 
foci. 

47. (new) The method of claim 5 further comprising the step of configuring a 
visual translucency of the reference surface in order to facilitate showing the time 
tracks extending below and above the reference surface. 

48. (new) The method of claim 8, wherein the visual elements positioned on 
the time tracks are icons. 

49. (new) The method of claim 29 further comprising the step of positioning 
the virtual location at an edge of the geospatial map in the spatial reference 
frame. 

50. (new) The method of claim 35 further comprising the step of removing at 
least one of the plurality of visual elements from at least one of the time tracks in 
response to the manipulation of the instant of foci with respect to a selected time 
range in the temporal reference frame. 

51 . (new) The method of claim 35 further comprising the step of removing one 
of the time tracks and the respective visual elements positioned thereon from the 
visualization representation in response to the respective visual elements 
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becoming outside of a selected time range in the temporal reference frame in 
response to the repositioning of the instant of foci. 

52. (new) The method of claim 35 further comprising the step of reassigning 
associated ones of the visual elements from the range of past time of the time 
tracks on one side of the reference surface to the range of future time of the time 
tracks on the other side of the reference surface In response to manipulation of 
the position of the instant of foci. 

53. (new) The method of claim 52 further comprising the step of positioning 
selected ones of the visual elements on the reference surface associated with 
ones of the data elements having a present time in the temporal reference frame 
corresponding to the time represented by the Instant of foci. 

54. (new) The method of claim 52 further comprising the step of positioning 
selected ones of the visual elements above the reference surface associated with 
ones of the data elements having a present time in the temporal reference frame 
corresponding to the time represented by the instant of foci. 

55. (new) The method of claim 53, wherein the position of each of the 
selected visual elements is selected from the group comprising: at the location of 
interests; and interpolated between the location of interests. 

56. (new) The method of claim 53 further comprising the step of animating the 
change in position of each of the selected visual elements on the reference 
surface as the positions of the instant of foci are manipulated, such that the 
visual properties of the plurality of visual elements in the visualization 
representation are updated in both the temporal and spatial domains. 

57. (new) A system for creating a multidimensional visual representation of a 
group of data elements having integrated temporal and spatial properties, the 
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data elements being included in the visual representation as a corresponding 
plurality of visual elements, the system comprising: 

a visualization manager for assembling the group of data elements 
including a first data element represented by a first visual element of the plurality 
of visual elements and a second data element represented by a second visual 
element of the plurality of visual elements; 

a spatial visualization component configured for generating a spatial 
domain of the visual representation to include a reference surface for providing a 
spatial reference frame having at least two spatial dimensions, the reference 
surface for relating the first visual element to a first location of interest in the 
spatial reference frame and relating the second visual element to a second 
location of interest in the spatial reference frame; 

a temporal visualization component configured for generating a temporal 
domain of the visual representation operatively coupled to the spatial domain, the 
temporal domain for providing a common temporal reference frame for the 
locations of interest, the temporal domain including a first time track coupled to 
the first location of interest and a second time track coupled to the second 
location of interest, the first visual element positioned on the first time track and 
the second visual element positioned on the second time track, each of the time 
tracks extending with respect to the reference surface and configured for visually 
representing a respective temporal sequence of a plurality of the data elements 
at each of the locations of interest; and 

an interactive control component for positioning a respective instant of 
focus at the intersection region between each of the time tracks and the 
reference surface at the respective locations of interest, the instant of foci being 
used for visually distinguishing a range of past time in the temporal domain 
preceding the instant of foci and a range of future time in the temporal domain 
after the instant of foci, each of the instant of foci configured for synchronous 
repositioning along their respective one of the time tracks; 

wherein the visual representation is displayed on a user interface for 
subsequent interaction with user events. 
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58. (new) The system of claim 57, wherein the visual representation of the 
group of data elements Is selected from the group comprising; a concurrent time 
and geographic context and a concurrent time and diagrammatic context. 

59- (new) The system of claim 58, wherein the diagrammatic context includes 
a plurality of nodes of a defined process, such that one of the nodes is positioned 
at the first location of interest and a second one of the nodes is positioned at the 
second location of interest. 

60. (new) The system of claim 59 further comprising a time range indicator of 
the temporal reference frame for specifying a range selected from the group 
comprising: the range of past time of the temporal sequence preceding the 
instant of focus; and the range of future time of the temporal sequence after the 
instant of focus. 

61 . (new) The system of claim 4 further comprising a time range indicator of 
the temporal reference frame for specifying the range of past time independently 
from the range of future time. 

62. (new) The system of claim 4 further comprising a time range indicator of 
the temporal reference frame for specifying the range of past time and the range 
of future time independently from the instant of foci. 

63. (new) The system of claim 57, wherein the plurality of the visual elements 
are arranged along the time tracks according to the times at which the 
corresponding data elements occurred in the temporal reference frame, at least 
one of the plurality of the visual elements being independent and as such being 
not related to either of the first and second visual elements. 

64. (new) The system of claim 57, wherein the location data element type is 
selected from the group comprising; a physical location on a geospatial map, a 
physical location as a node in a diagram, and a virtual location related to a 
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geospatial map such that the virtual location is not assigned to a specific physical 
location on the geospatial map. 

65. (new) The system of claim 64, wherein the virtual location is positioned at 
an edge of the geospatial map in the spatial reference frame. 

66. (new) The system of claim 58, wherein an association describes a pairing 
between two or more of the data elements for providing an information data 
object related to both of the two or more data elements. 

67. (new) The system of claim 66, wherein the information data object is 
selected from the group comprising: a communication connection describing 
communication details transferred between the two or more data elements; a 
financial transaction or other transaction; and a relationship connection 
describing social details in common between the two or more data elements. 

68. (new) The system of claim 57, wherein the position of the instant of foci is 
configured for manipulation on the time tracks for facilitating synchronous 
modification of the visual properties of the plurality of visual elements on the time 
tracks. 

69. (new) The system of claim 68, wherein synchronous modification of the 
visual properties of the plurality of visual elements includes concurrent and 
continuous updating as the instant of foci are repositioned on the time tracks. 

70. (new) The system of claim 68, wherein the visualization manager is further 
configured for adding at least one further visual element on one of the time tracks 
in response to the manipulation of the instant of foci with respect to a selected 
time range in the temporal reference frame. 

71 . (new) The system of claim, wherein the visualization manager is further 
configured for removing at least one of the plurality of visual elements from at 
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least one of the time tracks in response to the manipulation of the instant of foci 
with respect to a selected time range in the temporal reference frame. 

72. (new) The system of claim 68, wherein the visualization manager is further 
configured for removing one of the time tracks and the respective visual elements 
positioned thereon from the visualization representation in response to the 
respective visual elements becoming outside of a selected time range in the 
temporal reference frame in response to the repositioning of the instant of foci. 

73. (new) The system of claim, wherein the visualization manager is further 
configured for reassigning associated ones of the visual elements from the range 
of past time of the time tracks on one side of the reference surface to the range 
of future time of the time tracks on the other side of the reference surface in 
response to manipulation of the position of the instant of foci. 

74. (new) The system of claim 73, wherein the visualization manager is further 
configured for positioning selected ones of the visual elements on the reference 
surface associated with ones of the data elements having a present time in the 
temporal reference frame corresponding to the time represented by the instant of 
foci. 

75. (new) The system of claim 73, wherein the visualization manager is further 
configured for positioning selected ones of the visual elements above the 
reference surface associated with ones of the data elements having a present 
time in the temporal reference frame corresponding to the time represented by 
the instant of foci. 

76. (new) The system of claim 74, wherein the position of each of the selected 
visual elements is selected from the group comprising: at the location of 
interests; and interpolated between the location of interests. 
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77. (new) The system of claim 74, wherein the visualization manager is further 
configured for animating the change in position of each of the selected visual 
elements on the reference surface as the positions of the instant of foci are 
manipulated, such that the visual properties of the plurality of visual elements in 
the visualization representation are updated in both the temporal and spatial 
domains. 

78. (new) The system of claim 68, wherein the visualization manager is further 
configured for changing the displayed visual properties of the connection visual 
element in response to the manipulation of the instant of foci . 

79. (new) The system of claim 78, wherein the connection visual element is 
associated with movement of an entity visual element across the visual 
representation between the first location of interest and the second location of 
interest, the entity visual element representing an actor involved in a selected 
event. 

80. (new) The system of claim 68, a filtering function is applicable to the visual 
elements and the at least one related association to select a subgroup thereof, 
selection of the subgroup according to a method selected from the group 
comprising; criteria matching, algorithmic methods, and manual selection. 
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